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ABSTRACT 

A  method  for  determining  the  optimal  or  near-optimal 
search  path  for  the  wake  of  a  moving  target  when  the  search- 
er's motion  is  constrained  is  presented.  The  problem  us?s  a 
Markov  motion  model  in  discrete  time  and  space  for  the 
target  and  assumes  that  the  searcher  is  constrained  to  move 
only  from  the  currently  occupied  osll  j  to  a  specified  set 
of  "neighbor  cells",  I (j)  .  First,  a  discussion  of  the 
complexity  of  the  problem  is  presented.  Next,  an  extension 
of  T.J.  Stewart's  constrained  searoher  algorithm  is  given. 
Stewart's  algorithm  uses  S.S.  Brown'  s  unconstrained  searcher 
algorithm  to  calculate  bounds  on  the  probability  cf  non- 
detection.  An  extension  of  Brown's  algorithm  to  allow  the 
use  of  a  wake  detector  is  also  given.  Several  alternatives 
to  both  algorithms  are  offered  and  compared.  Finally,  some 
further    extensions    to  the   algorithms    are   suggested. 


TABLE    OF    CONTESTS 


I.  INTRODQCTION     9 

A.       THE    PROBLEM 9 

II.  THE    ALGORITHMS   USED 11 

A.       STEWART1 S    ALGORITHM       11 

1.  Definition   of   Symbols 11 

2.  Logic 12 

3.  Alternatives 13 

3.       BRDWN»S    ALGORITHM 15 

1.  Definition   of  Symbols 17 

2.  Logic 18 

3.  Alternatives 19 

III.  WAKE    DETECTION 22 

A.  BACKGROUND 22 

B.  DEFINITION  OF    SYMBOLS 22 

C.  LOGIC 23 

IV.  RESULTS       27 

A.  DESCRIPTION   OF    THE    COMPUTER    PROGRAM       27 

B.  OPTIMALITY   OF    THE    ALGORITHM    OUTPUT 33 

C.  RUN    TIME    COMPARISON    OF    THE    ALGORITHMS       .     ...  34 

V.  EXTENSIONS 40 

A.  Pd   AS    A    FUNCTION    OF    WAKE    AGE 40 

B.  COUNTER-DETECTION 40 

C.  APPROXIMATIONS    TO    THE    OPTIMAL    SOLUTION     ....  42 

VI.  CONCLUSIONS 43 

A.  PROBLEM    COMPLEXITY 43 

B.  CHOICE   OF    AN    ALGORITHM 43 


C.  WAKE    SEARCH UU 

D.  ACKNOWLEDGEMENTS 4  5 

APPENDIX    A:       DISCUSSION    OP    THE    COMPLEXITY    OF    THE 

SEARCH     PROBLEM     46 

APPENDIX    B:       GRAPHICAL   COMPARISON    3F    ALGORITHM 

RUNTIMES 50 

LIST    OF    REFERENCES 63 

INITIAL    DISTRIBUTION    LIST    6U 


LIST    OF   TABLES 


I.  Non-Optimal    Solutions 

II.  Number  of  solutions    for   25   Call  Grid,    Tl=2 

III.  Algorithm   Runtimes    for    25   Csll   Grid,    Tl=2 

IV.  Number  of   Solutions    for   Tmax=10,    All   Casas 

V.  Algorithm   Runtime   for   Tmax=10,    All   Cases    . 


3U 
36 
37 
38 
39 


LIST    OF    FIGURES 


2. 

1 

2. 

2 

4. 

1 

a. 

2 

a. 

3 

a. 

a 

a. 

5 

5. 

1 

3. 

1 

5. 

2 

B. 

3 

3. 

4 

3. 

5 

3. 

6 

3. 

7 

3. 

8 

B. 

9 

3. 

10 

3. 

11 

3. 

12 

Example   Search   Problem 17 

Sample    Calculation    of   Pc«S1(1) 18 

Example   Determinis tically  Generated  Problem      .    .    28 

Example   Randomly  Generated   Problem    28 

Problem  Generation    Subroutines    29 

Program   Solution   Subroutines    31 

Example   Program    Dutput 32 

Search    Problem   Modified   for 

Counter-Detection      41 

4   Cell    Grid,   T1=0,    and   Tmax=1,10 51 

4   Cell    Grid,   Tl  =  1 ,    and   Tmax=1,10 52 

4   Cell    Grid,   Tl=2,    and   Tmax=1,10 53 

9   Cell    Grid,    Tl=0,    and   Tmax=1,10 54 

9   Cell    Grid,   Tl  =  1  ,    and   Tmax=1,10 55 

9   Cell    Grid,   Tl=2,    and   Tmax=1,10 56 

16    Call   Grid,   Tl=0  ,   and   Tiax=1,10      .......    57 

16   Call   Grid,   Tl=1  ,   and   Tiax=1,10 58 

16    Call   3rid,   Tl=2,    and    Ti*x*1,10 59 

25   Call   Grid,   Tl*0 ,   and   Taax  =  1,10 60 

25   Call   Grid,   Tl=1,    and    Taax  =  1,10 61 

25   Call   Grid,   Tl=2  ,    and   Taax  =  1,10 62 


I-   I51Boducti3n 

A.       THE    PBOBLEM 

The  problem  considered  here  is  the  search  for  the  wake 
of  a  moving  target  in  discrete  time  and  space.  The  *arg<=t  is 
assumed  to  move  through  a  finite  number  cf  cells  according 
to  a  known  Markov  process.  The  goal  is  to  maximize  the 
probability  of  detection  by  some  specified  time,  t.  The 
searcher  is  assumed  to  be  partially  constrained  in  his 
motion  through  the  search  area,  being  able  to  move,  in  one 
time  period,  from  one  cell  to  a  limited  number  cf  cells  in 
close  proximity.  The  searcher  is  also  assumed  to  have  an  *n 
time  period  wake  detector.'  The  detector  is  capable  of 
detecting  wakes  left  in  a  cell  by  the  target  up  tc  n  "-ime 
periods    earlisr. 

The  approach  taken  to  solve  the  problem  was  *o  extend 
the  method  of  T.J.  Stewart,  [Ref.  1]  and  S.S.  Brown, 
[Ref.  2],  Stewart  addressed  searcher  employment  for  thras 
cases:  where  the  searcher's  effort  was  infinitely  divisible 
among  all  cells,  only  partially  divisible,  or  totally  indi- 
visible. The  three  cases  correspond  to  the  situation  where: 
searcher  effort  could  be  divided  among  all  the  possible 
cells  during  each  time  period,  searcher  effort  could  cover 
some  of  the  cells  during  each  time  period,  and  searcher 
effort  could  only  cover  one  cell  luring  each  time  period. 
Stewart  preseited  algorithms  for  finding  optimal  or  near- 
optimal  solutions  for  the  first  and  third  cases  and 
suggested  possible  methods  for  solving  the  second  case. 
This  thesis  generalizes  the  third  case  to  allow  for  wake 
detection;  i.e.,  the  target  can  be  detected  at  each  time 
period  in  each  of  several  cells  through  which  the  target  has 
previously   passed  in    the   last   n   time    periods. 


A  major  difficulty  of  the  algorithms  of  Stuart  and  Brown 
is  that  they  are  not  guaranteed  to  produce  the  optimal  solu- 
tion for  reasons  which  will  be  discussed  later.  This 
failure  to  always  find  optimal  solutions  for  the  indivisable 
effort  case  suggests  that  this  problem  might  be  fundamen- 
tally intractable. 

One  of  the  recent  advances  in  computer  science  is  the 
idea  of  algorithmic  complexity  and  NP-  Completeness. 
NP-Completer.ess  refers  to  the  inherent  intr actablility  or 
difficulty     of        a      problem.  Generally,         NP-Completer.ess 

describes  a  set  of  problems  which  have  been  shown  to  be 
solvable  by  an  efficient  algorithm  which  is  run  on  a  non- 
deterministic  Turing  Machine.  An  efficient  algorithm  is  one 
which  will  solve  a  problem  in  an  amount  of  time  proportional 
to  a  polynomial  function  of  the  length  of  the  input  needed 
to  describe  the  problem.  Well-known  NP-Complete  problems 
include  traveling  salesman  problems,  the  knapsack  problem, 
and   integer     programming   problems.  In   Appendix      1    a      more 

complete  discussion  is  presented  of  the  complexity  of  the 
search  problem      forming   the    basis      for   this   thesis.  It    is 

suspected  (but  has  not  been  proved)  that  this  search  problem 
is  no  easier  than  NP-Complete  problems  and  may  be  N?-Hard. 
If  so,  then  the  investigation  of  heuristic  or  approximate 
solution   algorithms    is  warranted.  For   further    information 

on   NP-Completeness    refer   to    [Ref.    3]. 
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II.    THE    ALGORITHMS    OSED 

As  mentioned  earlier,  the  algorithms  used  to  sclv*  the 
search  problem  were:  1)  r.J.  Stewart's  Constrained  Search 
algorithm  [Ref.  1],  and  2)  Brown's  Unconstrained  Search 
algorithm,        "Ref.    2].  The   Constrained     Search      Algorithm 

assumes  the  searcher  is  constrained  in  his  motion  during  the 
search,  i.e.,  the  searcher  can  go  from  his  current  cell  to 
some  subset  of  all  the  other  cells  in  the  grid.  The  uncon- 
strained searcher  algorithm  puts  no  constraints  on  searcher 
motion  but  does  assume  that  the  first  t  search  cells  are 
fixed  and  tries  to  optimize  the  search  by  choosing  the  cells 
to  search  from  t+1  to  T.  Even  in  the  unconstrained  problem, 
search   is   limited  to   one   cell   per   time    period. 

A.       STEWART'S    ALGORITHM 

1 .      Definition    of  Sy.mbo  Is 

J    =   set   of  all  cells   in    the   problem 

jsJ     =  a    particular  cell 

I(j)  =  matrix  of  all  cells  in  J  that  the  searcher  can 
reach   from  cell    j    (different   for    each    j    J) 

ji      =   the  cell  to   searched    at   time    i 

{ jO, j1 ,. . ., jt}    =    a  given    search  plan 

K(t,jt)  -  matrix  of  all  cells  in  J  searchable  at  time  t+1 
from  cell  jt  that  have  not  yet  been  considered  in  candi- 
date  search    plans 

p  =  probability  of  non-detection  for  the  current  best 
solution    (search    plan) 
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St  (i)      =      the   nxn    search    matrix      for    time   period      t    whsrs 
cell    i   is  the   cell  to   b3    searched 

1  ]  =    a   column   vector   of    1's 

2.      Logic 

The    following  algorithm   was    taken    from   [Ref.    1]. 

1.  Set  t=0,  p=1;  Selsct  a  cell  to  be  searched,  jO ;  set 
K(0,iO)=I  (jO)  . 

2.  Solve  the  substitute  problen  (discussed  below)  for 
search  over  periods  t+1,  t+2,...,T,  with  the  searcher 
at  jt  prior  to  the  search,  and  with  searcher  location 
in  the  first  period  (i.e.  t  +  1)  restricted  to  K(t,jt). 
Obtain  thereby  (also  discussed  later)  a  lower  bound  p 
on  the  optimal  probability  of  non-detection  when 
searcher  paths  are  restricted  to  those  passing 
through     f jO, j  1 , . . . , j t} . 

3.  If  p<p,  goto  step  (6).  Otherwise,  it  is  now  proved 
that  all  continuations  of  the  current  path  are  non- 
optimal,  i.e.  the  arc  from  (t-1,jt-1)  to  (t,jt)  is 
fathomed,    goto  step     (4)  . 

4.  If  t=0,  the  algorithm  terminates  (all  paths  from  jO 
are  fathomed)  ;  the  current  best  solution  is  optimal. 
If  t>0,    goto    step    (5)  . 

5.  Delete  the  current  jt  from  K(t-1,jt-1)  and  set  t=t-1. 
If  K(t,jt)  is  now  empty,  the  arc  from  (t-1,jt-1)  to 
(t,jt)  is  implicitly  also  fathomed.  Thus  return  to 
step    (4)  .    Otherwise,    return   to    step    (2)  . 

6.  Select  the  element  of  K(t,jt)  appearing  in  the  solu- 
tion to  the  substitute  problem  and  call  this  jt  +  1  ; 
set  t=t*1.  If  t<T,  set  K(t,  jt)  =I(  jt)  and  return  to 
step  (2)  .  If  t-T,  evaluate  the  probability  of  non- 
detection  when  the  searcher  path  is  {jO,  j  1  , . . .  ,  jT)  . 
If  this    probability    is   less   than    p,    then    replace  p   by 
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this    value  and  install      (jO#  j1  f.  .  .  ,  jT}    as    *he    current 
best   solution.    Return   to   step    (5)  . 
Essentially      the      algoritha        solves      the      partially 

constrained  problem  (unconstrained  after  time  t*1)  at  each 
level  to  obtain  a  lower  bound  on  the  probability  of  non- 
detection  for  any  fully  constrained  searchers  that  have  the 
same  initial  search  {jO, .. .  , jt*1}  .  The  algorithm  then  trav- 
erses each  branch  whose  lower  bound  is  less  than  the  current 
best  solution  probability.  When  t=r,  the  search  is  now  fully 
constrained;  and  ,  if  its  probability  of  non-detection  p  is 
less  than  p,  then  it  is  a  better  search  plan  and  is  saved. 
When  no  branches  with  probabilities  less  than  the  current 
best  plan  are  left,  the  problem  is  completed  and  the  current 
best    plan   is  optimal. 

Optimality  is  guaranteed  if  the  lower  bounds 
obtained  froa  the  application  of  Brown's  algorithm  are 
indeed  lower  bounds.  Unfortunately,  due  to  the  nature  of  •'rhe 
problem,  (an  integer  programming  problem)  the  results  of 
Brown's  algorithm  are  not  necessarily  lower  bounds.  A  search 
plan  may  exist  whose  "lower  bound",  from  Brown's  algorithm 
is  higher  than  the  current  best  solution  yet  whose  actual 
probability  of  non-detection  for  a  fully  constrained  solu- 
tion is  lower  than  the  current  best  solution.  Thus  the 
branch  containing  the  optimal  solution  may  be  pruned. 
Therefore,  the  solution  produced  by  Stewart's  algorithm 
using  Brown's  algorithm  as  a  bound  will  not  necessarily  be 
optimal.  Nevertheless,  the  solution  sight  be  close  enough  to 
the    optimal    for    practical   problems   of    interest. 

3  •      Alternatives 

Stewart's  algorithm  is  essentially  a  depth-first 
search  through  a  tree  of  possible  solutions.  It  uses  Brown's 
algorithm  to  bound  the  branches  and  remove  those  branches 
which    do   not   contain    better      solutions   than   the   current  one. 
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The  depth-first  search  strategy  gsnerates  bounds  at  each 
level  of  the  tree  and  picks  the  bast  bound  at  that  level  to 
continue  the  bounding  procedure.  In  this  way  it  reaches  a 
fully  constrained  search  in  T  steps  as  it  progresses  down 
through  the  tree.  After  reaching  the  first  constrained  solu- 
tion the  algorithm  progresses  baoc  up  the  tree  checking 
other  branches  on  the  way  up.  The  algorithm  stops  when  it 
has  progressed  all  the  way  up  to  the  top  of  the  tree  and  has 
no    bounds   whioh    are    better    then  the   current   best    solution. 

Another  approach  is  to  use  a  best-first  strategy.  In 
this  strategy,  the  best  of  all  the  bounds  currently  calcu- 
lated is  chcssn  as  the  branch  to  futher  investigate.  After 
the  new  bounds  are  calculated  for  the  one  step  investiga- 
tion, the  best  bound  is  again  chosen  to  investigate.  As  the 
best  bound  is  chosen  it  is  checked  to  see  if  it  meets  the 
motion      constraints.  If      the        solution      does        meet      the 

constraints  then  the  algorithm  stops  with  the  best  solution. 
Using  the  best-first  strategy  presented  by  D.  R.  Smith  in 
[Ref.  4],  Stewart»s  algorithm  was  revised  and  is  presented 
below: 

1.  Set  t=3,  p=1;  select  jO  to  be  the  initial  search 
cell,   set   K  (0,j0)  =1  (  jO)  . 

2.  Solve  the  substitute  problems  (discussed  earlier)  for 
search  over  periods  t+1,t*2, . . ., T  ,  with  searcher  at 
jt  prior  to  the  search,  and  with  searcher  location  in 
the  first  period  (i.e.  t  +  1)  restricted  to  K(t,jt). 
Store  the  lower  bound  on  the  optimal  probability  of 
non-detection  for  each  of  the  elements  of  K(t,jt)  in 
a  priority  queue  based  on  the  lower  bound.  (i.e. 
store  the  search  { jo, . . . , jt*1 } ,  the  length  of  the 
constrained  part  of  the  search,  tc=t+1 ,  and  the  lower 
bound  for   each  element   of    K(t,jt)). 

3.  Select  from  the  priority  queue  the  search  with  the 
smallest  lower  bound  and  set  the  current  search  to 
that    chosen    search.    Set   t»tcf    set   K  (t,  jt)  =1  (it)  . 
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4.      Check  the   current   search   to   sea    if    it    meats    the    move- 
ment  constraints      (i.e.      check    for      feasibility).      If 
feasible,      then  stop,      the   current   search    is    the   best 
search.    Otherwise,    goto   step    (2>  . 
Essentially    whac      the   best-first   search   of      the  tree 
does      is    generate     bounds   for      each    branch      below    the      root. 
Than    it    picks  the   branch   with   the   bast    bound   to   continue   the 
investigation  of   the   trae.         After      bounds    are   generated    for 
each    branch     they   are  savad    on      a   priority   queua      from    which 
the    selection  of      the  best    bound   is   made.         A   priority    queua 
(in    the   implenentation,    a   priority   heap)    is   usad    to    minimize 
the    time     and  storage     requirements   necessary     to    store      tha 
bounds   and    find      the   best  bound.        Then      the   algorithm    picks 
tha    branch   with    the    best    bound  to   continue   the   investigation 
of   the  tree.      Onca    the  best    bound   is    found,    it    is    checked  to 
saa    if   it   conforms    to  the      movement    constraints.      If   it   dees 
conform,    the  algorithm  stops,      the   optimal   solution   has   been 
found.        Otherwise,      tha    branches      amanating   from    the    branch 
under    investigation    are   bounded   and   tha    algorithm    repeats. 

D.P..  Smith,  in  [Ref.  4],  arguad  that  the  best-first 
search  of  most  classes  of  random  trees  has  a  strictly 
smaller  expected  time  and  space  complexity.  Therefore,  it 
was  decided  to  compare  tha  best-first  and  depth-first  tree 
search  algorithms  for  both  use  of  computer  tima  and  cpti- 
mality  of  results.  The  bast-first  search,  howaver,  is  also 
plagued   by  tha    possible   non-optimalit y   of   Brown's   alcrorithm. 

B-       BROWN'S    ALGORITHM 

To  generate  a  lowar  bound  on  the  constrained  search 
given  that  the  search  during  time  periods  1,...,t  is  fixed, 
an   algorithm  presented  by   S.S.    Brown    in   [Ref.    2]    was   used. 

The  target  position  distribution  was  generated  using  an 
initial      probability    density      of   target      location      Po   and      » 
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Markovian  mctior.  model.  Po,  tha  target  initial  distribu- 
tion, is  a  vector  with  dimension  equal  to  the  number  of 
calls  in  the  spatial  grid.  Markovian  motion  is  described  by 
a  transition  matrix  T  that  contains  the  orobability  of 
moving  to  celL  j  given  that  the  targat  was  in  call  i.  after 
one  time  period,  the  new  target  location  density  is  Po«T. 
After  two  t ima  periods  it  becomes  Po«I2,  and  after  n  moves, 
it  becomes  Po»Tn.  To  implement  search  in  the  modal,  a 
search  matrix  St  (i)  for  time  period  t  was  usad  in  the  form 
of  a  diagonal  matrix  with  the  ith  diagonal  elamant  given  by 
the  probability  of  a  missad  detection,  and  the  other  diag- 
onal elements  equal  to  unity.  Therefore  the  vector  Pc«S1 (1) 
contains  the  probabilities  that  the  target  is  in  each  of  the 
cells  and  remains  undetected  after  a  one  rime-unit  search  in 
cell  1.  We  refer  to  this  vector  as  "the  defective  target 
location  mass  at  time  period  1".  Figure  2.1  illustrates  an 
example  search  problem.  Figure  2.2  illustrates  a  sample 
calculation  of  Po«S1(1).  A  four  tima-unit  search  in  cells 
1,  2,  4,  and  3  would  yield  a  defective  target  location  mass, 
Pt(i)    given    by    : 


Pt  (i)  =Po«S1(1)  »I>S2(2)  »r»S3  (H)  •T»SU  (3) 


(2.1) 


Tha    final   probability  of   non-detection    pnd   for  the    search   is 
given   by: 


Pnd=Pt  (i)  »1]    -  0.612 


(2.2) 
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Sample  3rid 
♦ + 

I   -  I  » 
j  ,  j  . 

♦ + 

The  target  transition  matrix 

.40  .30  .30  .0 

T=    .30  .40  .0   .30 

.30  .0  .40  .30 

.0  .30  .30  .40 

The  target  initial  probability  distribution 

Po  =   (0.00  0.  00  0.00  1.00) 

The   searcher   motion   constraint   matrix 

12  3  0  0 

12  4  0  0 

13  4  0  0 
2         3  4  0  0 

Number   of  cells    is        4 

The   Drobability    of  non-detection    is    0.500 

The    initial    search  cell    is         1 

An   exampla    Search  Matrix    for    a  search   in    cell    1 

0.50  0.0  0.0  0.0 

S1  (1)=  0.0  1.00  0.0  0.0 

0.0  0.0  1.00  0.0 

0.0  0.0  0.0  1.00 


Figure    2.1        Eranple   Search   Problei. 

1 •      Definition    of  Symbo Is 

Sj   =   The   search    plan   chosen    aftsr    j    iterations    of   Brown1  s 
algorithm 

Sj(t)      =   The    cell   to   bs    searched      in    time    period    t   in   the 
search  plan    Sj 

Pnd(Sj)      =  The   final   probability    of   non-detection   associ- 
ated   with  the   search   plan   Sj 
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.5  0.  0.  0 

Po«S1(1)     =    (.00    .00    .00     1.00)     •    3."  3."  1."  0 

0.  0.  0.  1 

=    (.00    .00    .00     1.00) 


•1 


Figure    2.2        Sample   Calculation   of   Po»S1(1). 

2 .      Logic 

1.  Given  an  initial  guess  So  at  a  search  planr  and  given 
a    solution   tolerance    e>0f    set    t=1,    j  =  1 ,    and    S1=So. 

2.  Choose  Sj(t)  to  minimize  pafl  (Sj)  ,  (Sj  (i)  is  fixed  in 
this  minimization  for  i#t.)  The  minimization  is  done 
by  calculating  Pnd(Sj)  for  all  possible  choices  of 
Sj(t)  and  choosing  the  Sj  (t)  which  has  the  smallest 
Pnd(Sj)  . 

3.  If  t=T,  goto  step  u.  otherwise,  increment  t  and  goto 
step    2. 

4.  If  Pnd(S  j-1)  -Pnd(Si)  <e,  stop.  Pnd(Sj)  is  *he  desired 
bound.  Otherwise,  increment  j,  set  t=1,  set  Sj=Sj-1, 
and  aoto    step    2. 

Brown* s  algorithm  is  an  iterative  improvement  algo- 
rithm, where  at  each  time  step  t  the  cell  which  minimizes 
Pnd  is  chosen,  given  that  the  rest  of  the  search  before  and 
after  t  is  unchanged.  When  the  Pnd  for  Sj  is  within  e  of  the 
Pnd  for  Sj-1,  the  algorithm  is  terminated  and  search  Sj  is 
used . 

Brown! s  algorithm  in  the  totally  divisible  case, 
where  at  each  time  period  t  the  solution  to  the  stationary 
search  problem  is  found  holding  the  searches  for  time 
periods  before  and  after  t  fixed,  will  converge  to  the 
optimal  solution   as    proved      in  [ Ref .    2].         However,      because 
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the  implementation  here  only  allows  search  in  one  cell 
during  each  time  period  the  solution  space  becomes  discon- 
tinuous and  thus  non-convex.  Therefore,  the  algorithm  is  not 
guaranteed   to  converge  to   an  optimal    solution. 

3 .      Alternatives 

Brown's  algorithm  can  be  considered  to  find  the 
local  optimal  solution  given  a  starting  solution,  So. 
Therefore,  the  total  solution  space  is  partitioned  by 
Brown's  algorithm  into  those  starting  solutions  which  result 
in  the  optimal  solution  (the  global  optimum)  and  those 
starting  solutions  which  result  in  non-optimal  solutions 
(local  but  not  global  optimums.)  Based  on  this  partitioning 
idea    several  alternatives  are   available. 

The  first  is  to  choose  a  good  starting  solution.  If 
the  optimal  solution  were  used  as  the  starting  solution. 
Brown's  algorithm  would  always  arrive  at  the  optimal  solu- 
tion. However,  the  optimal  solution  is  not  known,  otherwise 
Brown's  algorithm  would  be  unnecessary.  Two  approaches  were 
used  to  guess  a  good  starting  solution:  1)  the  myopic  solu- 
tion, So(t)  is  chosen  to  give  the  most  improvement  to 
Pnd(So);  and  2)  a  random  solution,  a  random  number  generator 
is    used   to   generate    random    starting   solutions. 

As  mentioned  in  [Ref.  2],  if  a  zero  solution  is  used 
to  start  Brown's  algorithm  then  the  myopic  solution  will 
result  after  the  first  iteration.  The  myopic  solution  seems 
like  a  reasonable  choice  to  start  the  algorithm.  On  the 
other  hand,  there  might  be  some  negative  correlation  between 
the  optimal  solution  and  the  myopic  solution,  i.e.  the 
myopic  solution  may  lie  in  anothar  partion  which  does  not 
lead  to  the  optimal  solution.  Therefore  the  random  starting 
solution  was  also  considered  as  a  means  to  get  around  any 
possible  negative  correlation.  Since  the  random  solution  has 
a  finite  probability  of  choosing  tha  optimal  solution  it  may 
have    a   better  chance   of   starting  in   the   right   partition. 
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Another  approach  used  was  to  restart  Brown's  algo- 
rithm any  time  a  change  was  mada  to  the  currant  solution. 
The    revised   algorithm  is    presented  below: 

1.  Given  an  initial  guess  So  at  a  saarch  plan  sot  t=1r 
js1,    and    S1  =  Sc. 

2.  Choose  S1(t)  to  minimize  Pnd  (S j)  ,  <S1  (i)  is  fixed  in 
this  minimization  for  i*t.)  rha  minimization  is  dene 
by  calculating  Pnd(S1)  for  all  possible  choices  of 
S1(t)  and  choosing  the  S1(t)  which  has  the  smallest 
Pnd(S1»  . 

3.  If   S1(t)*So(t)    then    set    So(t}=S1(t)    and   goto   step    1. 

4.  If  t=T,  goto  step  5.  Otherwise,  increment  t  and  goto 
step   2. 

5.  Stop.   Pnd(S1)    is   the    desired   bound. 

This  variation  of  Brown's  algorithm  takes  an  initial 
solution  and  starts  at  the  first  tima  period  checking  for 
local  optimality  for  that  time  period.  If  the  choice  of  cell 
to  be  searched  at  the  currant  time  period  is  locally  optimal 
for  that  time  period  then  the  algorithm  goes  on  to  the  next 
time  period.  Otherwise,  tha  algorithm  inserts  the  new  search 
call    and      starts   back  at    the      first    time   period.  When   tha 

algorithm  goas  all  the  way  through  the  solution  without 
changes  it  stops.  This  approach  may  repartition  *he  solu- 
tion space  increasing  the  size  of  tha  partition  which  leads 
to   the  optimal    solution. 

Another  approach  which  was  not  used  is  to  run  the 
algorithm  sevaral  times  with  different  starting  solutions 
So.  Then  the  lower  bound  can  be  taken  as  the  minimum  of  the 
locally  optimal  solutions  returned  by  the  algorithm.  Also, 
the    lower  bound    can    be  estimated   by 


est=(P95«P5-P32.52)    /    (P9 5+P5-2«P32. 5) .  (2.3) 
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P5,  P95  and  P32.5  are  the  5TH,  95TH  and  32.5TK  p-rcer.'rile 
values.  This  estimate  is  based  on  the  idea  that,  as  the 
number  of  independent  solutions  produced  by  a  given  algo- 
rithm for  a  given  problem  increase,  the  solution  values 
converge  to  a  Weibull  distribution  whare  the  optimal  lower 
bound  is  the  location  parameter.  This  approach  was  not  used 
because  it  required  running  Brown's  algorithm  two  or  more 
times  to  calculate  each  bound  and  it  was  felt  that  xhe  addi- 
tional computar  time  would  not  improva  the  bounding  process 
significantly. 

A  final  approach  which  also  was  not  investigated,  is 
to  locally  optimize  the  choice  of  calls  over  2,  3  or  more 
time  periods  in  the  Brown  algorithm.  This  again  might 
increase  the  size  of  the  partition  which  leads  to  the 
optimal  solution. 
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III.    IAKE    DETECriOH 

A.  BACKGROUND 

As  mentioned  earlier,  this  thesis  is  an  attempt  to 
extend  existing  optimal  search  theory  techniques  to  the 
problem  of  wake  detection.  Stewart's  and  Brown's  algo- 
rithms, as  presented  in  the  last  chapter,  indicate  one 
method  for  solving  the  constrained  searcher  problem.  The 
next  question  is:  "How  does  one  extend  the  algorithms  to 
handle  the   possibility  of   wake    detection?" 

Stewart's  algorithm  does  no  aotual  calculation  of  the 
probability  of  non-detection,  it  uses  Brown's  algorithm  for 
the   calculation    of    bounds.  Therefore    Brown's    algorithm   is 

the  one  that  leeds  to  be  altered  to  allow  for  use  of  a  wake 
detector.      To   extend   the    algorithm   we    proceed   as    follows: 

B.  DEFINITION    OP   SYMBOLS 

Po  =  initial  target  probability  distribution  (i.e.,  the 
probability  that  the  target  is  in  any  cell  i  at  the  start 
of   the   problem.) 

St  (i)  =  an  nxn  matrix  which  reduces  the  defective  prob- 
ability mass  of  the  target  by  1-P  (d)  in  cell  i  searched 
at  time  t.  The  defective  probability  mass  of  the  other 
cells   remains   unchanged. 

T  ■  a  nxn  Harkov  transition  aatrix  which  contains  the 
probability  that  a  target  in  ceil  i  at  time  period  t  will 
transition  to  call   j   at    time   period   t+1. 

1]   ■   a   nx1   column    vector    of   1's. 
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C.       LOGIC 

What  needs  to  be  extended  is  ths  model  under  which  the 
non-detection  probability  is  calculated.  As  shown  earlier, 
this  calculation  for  a  non-wake  detector  in  a  4  time  unit 
search  is 


Pnd=Po»S1  •T«S2«T«S3«T»S4«  1  ].  (3.1) 

It  is  now  proposed  to  allow  the  searcher  to  carry  an 
•n-time  unit  wake  detector.'  This  detector  has  the  capa- 
bility of  detecting  wakes  in  the  cell  being  searched  which 
were  made  by  the  target  up  to  n  tins  periods  earlier.  To 
extend  the  model  to  handle  'n-time  unit  wake  detectors'  two 
assumptions  are  made. 

First,  it  is  assumed  that  each  wake  search  for  each  time 
period  is  independent  of  all  other  searches.  For  example, 
when  a  searcher  searchs  cell  2  at  time  period  3  with  a  2 
time  unit  wake  detector  he  is  completing  three  separate  and 
independent  searches.  The  first  is  of  cell  2  looking  for  the 
wake  made  by  the  target  daring  time  period  3,  the  second  is 
of  cell  2  looking  for  the  wake  made  during  time  period  2f 
and  the  third  is  of  cell  2  looking  for  the  wake  made  during 
time  period  1.  Note  the  searcher  has  also  completed  a 
search  during  time  periods  2  looking  for  wakes  made  during 
time  periods  1  and  2,  and  a  search  during  time  period  1 
looking  for  wakes  made  during  time  period  1.  Therefore,  in  a 
3  time  period  search  with  a  two  time  period  detector  the 
searcher  has  made  a  total  of  6  independent  searches  in  3 
cells,  the  cells  he  chose  to  search  at  time  periods  1,  2, 
and  3  . 

Also  note  that  the  target  is  assumed  not  to  have  left  a 
wake  prior  to  the  start  of   the  problem  for  ease  of  computer 
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calculation  and  formulation  of  ths  problem.  This  does  not 
restrict   the  result. 

The  second  assumption  is  that  we  are  trying  to  calculate 
the  probability  of  non-detection  after  the  specified  length 
of  search  is  completed.  We  are  not  trying  to  evaluate  the 
probability  of  non-detection  at  intermediate  points  in  the 
search. 

Based  on  those  two  assumptions,  the  wake  detection 
concept  can  be  considered  a  simultaneous  search  of  the  cell 
the  searcher  is  in  now,  the  ceil  the  searcher  will  be  in 
next  time  period,  the  ceil  the  searcher  will  be  in  two  ■'rime 
periods  from  now,  etc.,  out  to  the  maximum  number  of  time 
periods  the  wake  is  detectable  or  to  the  number  of  time 
periods  remaining  in  the  problem,  wiichever  is  smaller.  The 
wake  search  is  modeled  as  if  an  equivalent  search  is 
conducted  simultaneously  with  the  real-time  search,  i.e. 
searching  for  a  wake  in  cell  j  which  is  t  time  periods  old 
is  equivalent  to  searching  in  cell  j  ,  t  time  periods 
previous,  simultaneously  with  the  other  searches  being 
conducted  t  time  periods  previous  and  waiting  t  time  periods 
to    discover   the    results   of    the   search. 

As  shewn  previously,  the  probability  of  non-detection 
for  the  search  without  wake  detection  can  be  calculated  from 
the  product  of  a  series  of  matricies  as  shown  in  equation 
3.1.  For  a  search  in  the  same  cells  but  with  a  one  tima 
unit    wake   detector,    the   probability    of   non-defection   is 


Pnd=Po«S1  •S2»T»S2«S3«T«S3«S<4»T«SU»1  ].  (3.2) 

The  vector  Po,  as  defined  earlier,  is  the  probability 
that  the  target  is  in  cell  i  at  the  start  of  the  problem. 
The  vector  Po«S1  is  the  probability  the  target  was  in  cell  i 
at      time   period      1    and     has   not      been    detected      by   the      wake 
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search  conducted  during  time  period  1  looking  for  a  wake 
left  in  time  period  1.  The  vector  Po«S1«S2  is  the  prob- 
ability the  target  was  in  cell  i  it  time  period  1  and  has 
not  been  detected  by  wake  searches  during  rime  periods  1  and 
2  looking  for  wakes  created  in  tiie  period  1.  The  vector 
Po«S1»S2»T  is  then  the  probability  that  the  *:arget  is  in 
cell  i  at  tiae  period  2  an d  has  not  been  detected  by  wake 
searches    locking   for   wakes    created   during   time   period    1. 

Following  the  same  line  of  reasoning,  the  vector 
Po«S1»S2«T«S2»S3«r»S3«SU  is  the  probability  that  the  target 
is  in  cell  i  at  time  period  3  and  his  not  been  detected  by 
wake  searches  looking  for  wakes  created  during  time  period  3 
and  prior.  Of  note  is  the  idea  that  -he  searcher  in  effect 
conducts  simultaneous  searches  of  2  cells  during  a  given 
time  period  but  dees  not  receive  the  results  of  the  one  time 
unit    wake   search   until  the    next   time    period. 

The  wake  detection  problem  is  analagous  -o  the  problem 
where  a  homeowner  thinks  there  are  mice  in  his  house  and  he 
wants  to  confirm  his  suspicions.  Each  room  of  the  house  has 
two  tape  recorders:  one  which  is  available  for  replay  of 
what  noises  were  recorded  in  the  previous  hour  and  the  other 
which  is  recording  the  current  hour.  The  owner  car.  enly  go 
to  adjacent  rooms  which  have  doors  tD  the  current  room.  He 
spends  one  hDur  in  the  room  of  hie  choice  listening  for 
mice.  Once  in  a  room  he  can  listen  for  mice  and  at  the  same 
time  listen  to  the  tape  recording  of  the  previous  hour.  The 
probability  of  detecting  the  mice  oa  the  tape  recorder  or  by 
listening  in  a  room  is  the  same.  The  owner  now  must  decide 
how  to  search  the  house  to  maximize  his  chances  of  finding 
the    mice. 

The  tape  recordings  of  the  noiss  in  each  room  are  esen- 
tially  independent  and  simultaneous  searches  of  each  room  in 
the  house.  The  owner  can  only  determine  the  results  of  the 
search  by  tape    recorder   if    he   enters    the   room   and    listens   to 
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the  tape  recorder.  If  the  owner  loasn't  listen  *o  the  tape 
recorder  during  the  hour  the  second  recorder  is  taping  the 
room,  the  first  recorder  is  rewound  and  starts  taping  thus 
destroying   tha    results  of  that    particular   search. 

The  key  assumptions,  as  stated  earlier,  are  that  the 
searches  are  independent  and  that  the  goal  is  to  minimize 
the  probability  of  non-detection  ovsr  a  given  search  length. 
Therefore  tha  matrix  multiplication  in  eguaticn  3.2  is 
valid.  For  a  two  time  unit  detector,  the  probability  of 
non- detection  is 


Pnd=Po«S1»S2«S3»T»S2«S3«S4«T«S3«54«T«S4«1  ].  (3.3) 

The  matrix  multiplication  can  be  extended  for  a  Tl  capacity 
wake  detector  where  Tl  is  the  time  late  a  searcher  can  enter 
a  cell  and  still  detect  the  targets  wake.  For  the  Tl 
capacity   detector  equation    3.2   becoies 


Pnd=Po»ST1«T«ST2»T»ST3«T»  ST<+».  .  ••5Il&Z*1  ]•  (3.4) 


wh  e  r  e 


.      min  (Tmax,  i+rl) 

Sfl    =    n.  St(j)  (3.5) 


26 


I?.     RESULTS 

A.       DESCRIPTION    OP    THE  COMPUTER    PR03RAH 

The  algorithms  presented  in  tha  preceding  chapters  were 
implemented  on  the  U.S.  Naval  Postgraduate  School's  IBM  3033 
computer  system  in  Fortran  H  (axtanied) .  The  program  was 
constructed  of  a  main  driver  program  which  called  various 
subroutines    for    input,    calculation   and   output. 

The  operation  of  the  program  can  be  broken  down  into  two 
main  functions:  1)  generation  of  the  problem  including  the 
initial  target  distribution,  the  transition  matrix  and  the 
searcher  loveiant  constraint  matrix;  and  2)  solution  of  the 
generated   problem. 

The  generation  of  the  problem  used  two  methods.  In  one 
method  the  problem  generated  was  a  deterministic  one  where 
the  target's  initial  position  was  at  the  far  corner  away 
from  the  searcher  who  started  in  call  1.  Tha  target  tran- 
sition matrix  was  generated  assuming  that  the  target  had  a 
fixed  probability  of  staying  in  the  cell  it  currently  occu- 
pied and  the  remaining  probability  of  movement  was  divided 
evenly  among  the  calls  which  were  aljacent.  Diagonal  move- 
ment was  not  allowed.  Figure  4.1  shows  a  example  initial 
target  distribution  and  target  transition  matrix  for  the 
deterministic  case.  Tha  searcher  movement  constraint  matrix 
was  generated  by  allowing  the  searcher  to  move  only  from  the 
current   cell  to    an    adjacent    cell. 

In  the  second  method,  tha  problem  was  randomly  gener- 
ated. The  target  was  randomly  distributed  between  all  the 
cells  at  the  start.  The  target  transition  matrix  was  gener- 
ated assuming  a  fixed  probability  of  remaining  in  the 
current   cell  and   then  the      remaining    probability    of    movement 
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Po  =  (0.00    0.00    0.00    1  .00) 


r  = 

.40 
.30 
.30 
.00 

.30 
.40 

.00 
.40 

.30       .30 
.00       .30 
.40       .30 
.30       .40 

Figure   4.1        Exanple   Deterministioally   Generated   Problem. 

was      randomly  distributed      among      tlis      adjacent    cells.         The 
searcher      movement      constraint      matrix        was      determined     as 


Figure  4.2        Example    Randomly   Generated   Problem. 

before.  Figure  4.2  illustrates  a  typical  random  problem. 
Figure  4.3  shows  the  program  structure  and  subroutines  used 
to      generate  the     deterministic  and      random   problems.  The 

program   requires   6    inputs   as   defined    below: 

1.  Size   of    the    grid   i.e.    3x3,    4x4,    etc. 

2.  Probability  of  detection  of  the  target  if  the 
searcher  and  target  are  in  the  same  cell.  Also  used 
as  the  probability  of  detection  of  the  target  using 
the    wake    detector. 

3.  Fixed  probability  of  the  target  staying  in  the  cell 
it  currently    occupies,    (i.e.    rii) 
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4.  Whether  the  generated  problem  is  to  be  deterministic 
or  random. 

5.  Epsilon,  used  as  a  stopping  criteria  for  Brown's 
algorithm. 

6.  The  capability  of  the  wake  detector,  (i.e.  how  many 
time    units   late  will    the   detector   detect    a    wake.) 

Once  the  problem  was  generated  it  was  then  necessary  to 
find  the  optimal  solution  using  the  various  algorithms 
mentioned  earlier.  Seven  algorithms  were  used  to  find  the 
solution: 

1.  Depth-First  search  using  the  myopic  solution  to  start 
Brown's   algorithm. 

2.  Depth-First  search  using  a  randomly  chosen  solution 
to   start    Brown's   algorithm. 

3.  Depth-First  search  using  a  random  solution  to  start 
Brown's  algorithm  and  using  the  modification  which 
restarted  Brown's  algorithm  every  time  the  solution 
was   changed. 

4.  Best-First  search  using  the  myopic  solution  to  start 
3rcwn's    algorithm. 

5.  Best-First  search  using  a  randomly  chosen  solution  to 
start  Brown's   algorithm. 

6.  Best-First  search  using  a  random  solution  to  start 
Brown's  algorithm  and  using  the  modification  which 
restarted  Brown's  algorithm  every  time  the  solution 
was   changed. 

7.  Total  enumeration  of  all  possible  search  solutions  to 
determine  the  one  with  the  lowest  probability  of 
non^det ection . 

The  only  algorithm  guaranteed  to  produce  the  optimal 
solution  was  the  total  enumeration  algorithm  which  generated 
all      possible   feasible      solutions.  Figure      4.U    shows     the 

program    structure  and  subroutines   necessary   to   implement   the 
algorithms   and    problem  solution   part    of    the   program. 
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The   output    generated    by    the   program    included: 

1.  cpu    seconds    used   by    each   algorithm 

2.  number  of   unconstrained    solutions   checked 

3.  number  of  constrained   solutions   checked 

4.  probability   of  detection  of  the   target   after   search 

5.  search  plan    used 

Figure   4.5   presents    an  example   program   output. 
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1  -  DEPTH  FIRST  STRATEGY,  MYOPI3  INITIAL  SEARCH 

2  -  DEPTH  FIRST  STRATEGY,  RANDOM  INITIAL  SEARCH 

3  -  DEPTH  FIRST  STRATEGY,  RESTART  AFTER  EACH  CHANGE 

4  -  BEST  FIRST  STRATEGY,  MYOPIC  INITIAL  SEARCH 

5  -  BEST  FIRST  STRATEGY,  RANDOM  INITIAL  SEARCH 

6  -  BEST  FIRST  STRATEGY,  RESTART  AFTER  EACH  CHANGE 

7  -  TOTAL  ENUMERATION 
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Osing  the  program  described  above,  grid  sizes  of  4,  9, 
16,  and  25  cells  were  investigated.  All  seven  algorithms 
were  tested  on  deterministic  problems  with  Tmax=2 , . . . , 1 0  and 
Tl-0,1,2.  While  the  problem  sizes  considered  are  not  large 
enough  for  real  life  problems  it  was  felt  that  they  were 
large  enough  to  demonstrate  the  algorithms.  The  results  can 
then  be  extrapolated  to  determine  expected  running  times  for 
real    life   problems.       The    goal   was   to    answer   two    questions: 

1.  How  close  to  the  optimal  are  the  solutions  from  the 
branch-and-bound   algorithms? 

2.  How  do  the  running  times  of  the  algorithms  compare; 
to  each  other,  and  to  the  total  enumeration  algo- 
rithm? 

B.       OPTIHALITY    OP   THE    ALGORITHM    O0TP0T 

As  mentioned  earlier,  the  problems  under  consideration 
ranged  from  a  H  cell  grid  with  Tmax=2  and  T1=0  to  a  25  cell 
grid  with  Tmax=10  and  11*2.  The  total  number  of  possible 
constrained  solutions  ranged  from  3  to  275905.  Table  I  shows 
the  number  of  non-optimal  solutions  and  the  maximum  percent 
difference  between  the  optimal  and  non-optimal  solutions  for 
each  of  the  algorithms.  Since  the  problems  were  symmetric 
there        were  several        optimal  solutions,  so  the 

branch-and-bound  solution  could  be  an  equivalent  although 
different  solution  from  the  total  eamsration  solution.  This 
may  have  increased  the  probability  of  the  branch-and-bound 
algorithms  finding  the  optimal  solution.  Further  investiga- 
tion into  larger  random  problems  nay  yield  more  non-optimal 
solutions  and  larger  percent  differences,  however,  fully  96% 
of  Stewart*  s  results,  as  reported  i.i  [Ref.  1],  were  optimal 
with  the  non-optimal  results  being  within  .41%  of  the 
optimal  solution.  Therefore,  the  results  of  this  run  tend  to 
confirm  Stewart's  results  concerning  the  optimality  of  the 
branch-and-bound   algorithm    solutions. 
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TABLE    I 
Non-Optimal  Solutions 


Algorithms 
1  2  3  U  5  6 

Number 

of   Non-optimal  2  0  3  2  1  0 

Solutions 

Maximum    percent  mQU%        0%  d%        .  0H%      .0158  0% 

Error 


C.       RUH    TIME   COMPARISON    OF    THE    ALGORITHMS 

Since  all  the  algorithms  seea  to  be  able  to  find  the 
optimal  or  near-optimal  solution  without  too  much  diffi- 
culty, it  is  now  important  to  determine  which  algorithm 
performs  the  fastest,  while  the  total  enumeration  algorithm 
was  used  to  provide  a  benchmark  for  the  cptimality  of  the 
solutions  it  oan  also  serve  as  a  benchmark  for  the  run-time 
of   the  algorithms. 

The   runniig    time   of   the   total   enumeration   algorithm  is  a 

function   of   the    number  of   possible   feasible   solutions.         The 

number   of    feasible    solutions   is   based   on    how    many    places   the 

searcher   can  go    from    the      cell    he   currently   occupies.        From 

each    cell      the    searcher     can   transition    to      between    3      and  5 

cells.    If   the  searcher  is   in   a   corner   cell   he   can    stay    where 

he    is   or   transition    to  either      of   the    two    cells    which   border 

the    cell   he    is    in.       If  the    searcher    is    in   a   side    cell   he  can 

stay    where      he    is   or   transition      to    any   of    the      three   border 

cells.        If   tie    searcher    is    in   an   interior    cell    he    can   again 

stay    where      he    is  or     transition   to      any   of   the      four    border 

cells.      Therefore  the  total    number      of    feasible   solutions   is 

Tmax 
bounded    below   by   the    exponential   function    3  ,      where   Tmax 
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is      the      length    of      the     search.  The    number      of      feasible 

solutions      is      bounded     above    by     the      exponential      function 

Tmax 
5  .      Since  the   total   enumeration    algorithm   looks    only   the 

feasible    solutions    and  calculates   Pnd    for   each  one    the    algo- 

Tmax 
rithm   is   therefore    0  (e  )     or   of   exponential   complexity. 

The  branch -and- bound  algorithms  don't  lend  themselves  to 
such  easy  analysis.  The  worst  case  analysis  would  be  where 
the  bounds  are  so  weak  that  all  the  feasible  solutions  would 
have  to  be  checked.  The  average  case  analysis  is  much  more 
difficult.  Smith  in  [Ref.  4],  argued  that  the  best-first 
strategy  had  a  smaller  average  case  complexity  than  the 
depth-first  strategy.  Since  it  is  unclear  whether  the  trees 
generated  by  the  search  problem  fit  into  the  class  of  random 
trees  covered  by  Smith's  argument,  further  complexity  anal- 
ysis   will   not   be   attempted. 

Appendix  B  contains  graphs  of  the  run-time  for  all  seven 
algorithms  for  all  the  oases.  From  the  graphs  it  is  clear 
that  the  best-first  strategy  did  oitperform  the  depth-firs*- 
strategy  especially  as  the  problem  (as  measured  by  the 
number  of  possible  feasible  solutions)  increased  in  diffi- 
culty. This  is  supported  by  analyzing  the  number  cf  solu- 
tions checked  by  each  algorithm.  Table  II  shows  the  number 
of  solutions  checked  by  each  algorithm  for  the  25  cell  grid 
with    Tl  =  2. 

From  tabls  II  it  appears  that  until  time  period  6  the 
algorithms  looked  at  all  the  possible  solutions.  Sinc°  the 
total  enumeration  algorithm  didn't  look  at  any  intermediate 
solutions  it  was  faster.  After  time  period  6  the 
branch-and-boind  algorithms  where  able  to  use  the  pruning 
feature  to  a  great  extent  in  removing  unpromising  branches. 
Table  III  shows  the  runtimes  needed  to  used  in  generating 
the  solutions  in  table  II.  Based  oa  the  number  of  solutions 
calculated  by  each  algorithm  it  appears  that  the  best-first 
strategy    is     more  efficient.      Since    the      best-first    strategy 
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TABLE   II 
Nuaber   of   solutions   for   25   Cell   Grid,    Tl=2 


PARTIALLY   CONSTRAINED    SOLUTIONS 
(Brown's   Algorithm   Output) 


Algorithm 

Tmax 

1 

2 

3 

'4 

5 

6 

7 

2 

0 

0 

0 

D 

0 

0 

0 

3 

3 

3 

3 

3 

3 

3 

0 

a 

14 

14 

14 

14 

14 

14 

0 

5 

57 

57 

57 

57 

57 

57 

0 

6 

2  34 

234 

234 

234 

234 

234 

0 

7 

9  83 

983 

983 

983 

983 

983 

0 

8 

21  16 

2109 

2402 

1123 

1  123 

1  123 

0 

9 

3998 

4215 

2309 

1573 

1593 

1598 

0 

10 

2181 

4066 

4532 

1375 

1359 

1383 

0 

Totals 

10182 

1  1591 

10534 

5362 

5366 

5  395 

0 

CONSTRAINED    SOLUTIONS 


Algori 

tan 

max 

1 

2 

3 

4 

5 

6 

7 

2 

3 

3 

3 

3 

7 

i 

3 

3 

11 

11 

11 

11 

11 

11 

1  1 

4 

43 

43 

43 

43 

43 

43 

43 

5 

177 

177 

177 

177 

177 

177 

177 

6 

749 

749 

749 

749 

749 

749 

749 

7 

9  16 

563 

386 

100 

100 

100 

3235 

8 

12  73 

987 

1  U39 

3 

0 

0 

14139 

9 

601 

1552 

723 

160 

160 

160 

62309 

10 

2  46 

251 

765 

0 

0 

0 

275905 

Totals  4019       4336      4  296       1243       1243       1243    356571 


algorithms  had  almost  exactly  the  same  number  of  solution 
calculations  whereas  the  depth-first  strategy  algorithms 
were  more  divergent  it  could  be  hypothesied  that  the  best- 
first  strategy  is  more  tolerant  of  the  non-optimal  bounds 
produced   by    Brown's    algorithm. 

Table  IV  shows  how  the  number  of  solutions  varied  for 
all  the  cases  where  Tmax=10  (i.e.  where  the  maximum  number 
of   possible    feasible    solutions   was   noted.) 
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TABLE   III 
Algorithm   Runtimes   for   25   Cell   Grid,    Tl=2 


Algorithm 

Tmax 

1 

2 

3 

4 

5 

6 

7 

2 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

3 

0.2 

0.2 

0.  1 

0.2 

0.2 

0.  1 

0.0 

a 

1.  2 

1.2 

0.9 

1.2 

1.2 

0.8 

0.  1 

5 

5.8 

6.6 

4.5 

5.7 

6.4 

4.6 

0.  3 

6 

26.5 

27.8 

2  1.5 

26.2 

27.3 

22.2 

1.8 

7 

112.3 

1  18.3 

92.6 

106.0 

113.5 

87.8 

9.  3 

8 

331.  a 

342.6 

344.4 

240.9 

253.3 

278.9 

48.2 

9 

821  .4 

868.2 

794.5 

531.3 

547.5 

743.6 

248.  1 

10 

1253.  a 

1500.3 

225  2.4 

843.0 

845.0 

1494.  1 

1249. 1 

Totals    2552.2    2865.2    3510.9    1755.0    1794.4    2632.1    1556.9 

runtime   in  cpu   seconds 


Table  V  tabulates  the  running  time  required  to  generate 
the  solutions  for  the  cases  where  rmax=10.  From  the  tables 
it  can  be  seen  that  the  best-first  strategy  dominated  the 
depth-first  strategy,  mainly  because  it  had  to  look  a-  fewer 
solutions.  Also  it  can  be  seen  that  the  restart  algorithm 
was  not  competitive  when  rmax=10  for  any  of  "-he  cases.  This 
reflects  the  fact  that  it  must  restart  after  every  change  in 
the  current  solution  and  as  Tmax  increases  the  number  of 
changes  also  increases.  Therefore  the  restart  algorithm  is 
forced  to  restart  significantly  more  frequently  and  thus 
takes  longer  to  arrive  at  the  local  bound.  From  table  IV  it 
is  seen  that  the  extra  time  taken  to  calculate  the  bound  did 
not    reduce  the    number  of   solutions   which   were   investigated. 

It  is  apparent  that  the  best-first  strategy,  using 
either  the  myopic  or  random  starting  solution,  performed 
very  well  when  compared  to  any  of  the  other  algorithms.  As 
expected,      the      runtime   for    the   total      enumeration    algorithm 
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TABLE    IV 
No«ber   of    Solutions   for   Tmax=10,    All   Cases 


PARTIALLY    CONSTRAINED    SOLUTIONS 
(Brown's   Algoritha    Output) 

Grid          Tl  Algorithms 

Size  1  2  3  4  5  6  7 

0  978  1092  1011  912  894  385  0 

4     1  24  24  36  27  27  24  0 

2  39  24  51  51  33  33  0 

0  628  547  279  236  223  275  0 

9     1  247  213  213  121  81  80  0 

2  270  163  306  186  151  141  0 

0  1413  1002  1029  740  718  723  0 

16     1  910  419  419  332  409  400  0 

2  347  891  380  320  339  373  0 

0  4843  3481  4013  1343  1343  1343  0 

25     1  3371  3798  1266  1295  1283  1313  0 

2  2787  4065  4532  1375  1359  1383  0 

Totals  15857  15665  13535  5988  6860  5973  0 

TOTALLY  CONSTRAINED  SOLUTIONS 

Grid    Tl  Algorithms 

Size  1  2  34  5  6  7 

0  198  390  375  189  195  195  19683 

4            1  3  3  6  3  3  3  19633 

2  3  3  6  3  3  3  19683 

0  31  27  10  0  0  0  128715 

9             1  14  32  23  0  0  0  128715 

2  63  5  53  45  54  81  128715 

0  272  183  210  0  0  0  230175 

16            1  121  19  19  0  0  0  230175 

2  63  130  90  0  0  0  230175 

0  1365  479  801  0  0  0  2"75905 

25            1  1046  1240  10  0  0  0  275905 

2  246  251  765  0  0  0  275905 

Totals  3425  2762  2368  240  255  282  1963434 


increased  rapidly,    and  it    appears,    exponentially.      The    other 
alogorithms,        all        the      depth-first      algorithms        and      the 


38 


TABLE    V 
Algorithm    Runtime    for   T«ax=13,    All   Cases 


Grid   Tl  Algorithms 

Size  1  2                 3  4  5  6  7 

0  4.3  U. U            3.7  4.1  3.9  3.6  10.4 

4          1  0.4  0.4            0.7  3.4  0.4  0.6  10.7 

2  3.7  0.4            1.1  0.9  0.6  0.8  10.9 

0  17.9  16.1         18.8  10.4  8.0  17.6  150.8 

9          1  14.7  10.6         19.7  3.3  6.9  15.0  152.1 

2  14.3  8.2         25.3  10.9  9.0  17.1  153.5 

0  120.8  92.1       191.8  113.1  101.0  212.7  672.9 

16          1  174.0  119.4       221.5  119.2  114.9  220.4  671.9 

2  163.4  193.8       318.3  156.4  125.4  250.2  674.8 

0  661.0  679.2    1028.6  561.9  547.8  1094.6  1249.3 

25          1  1124.4  1092.0    1277.3  709.8  698.9  1262.0  1244.5 

2  1253.4  1500.3    2252.4  843.0  845.0  149U.1  1249.1 

Totals  3549.3  3734.9    5359.2  2538.9  2461,8  4588.7  6250.9 

runtime    in   cpu    seconds 


best-first  restart  algorithm,  tended  to  be  somewhere  between 
the  two  extremes.  In  the  final  case,  where  Tmax=10  and 
Tl=2,  the  total  enumeration  algorithm  was  still  competitive. 
It  is  anticipated  that  as  Tmax  is  increased  beyond  10  the 
total  enumeration  algorithm  will  surpass  all  the  other  algo- 
rithms  in  runtime  require!. 

Based  on  this  example,  it  appears  that  the  best-first 
strategy  with  either  the  myopic  or  random  starting  solution 
is  preferred.  Further  examples  might  indicate  a  preference 
between   the   myopic   and  random    starting   solutions. 
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7«    BXTENSIOgS 

A.  PD    AS    A    FUNCTION    OF    WAKE    AGE 

The  program  as  currently  written,  assumes  that  the  prob- 
ability of  detection  of  the  wake  is  constant  vi*h  the  age  of 
the  wake.  In  reality,  one  would  sxpect  the  probability  of 
detection  to  decrease  as  the  wake  age  increased.  This  would 
relatively  simple  to  implament.  What  would  be  needed  would 
be  either  a  separate  probability  of  detection  as  the  wake 
aged  or  a  functional  relationship  between  wake  age  and  prob- 
ability of  detection.  The  program  would  then  have  to  be 
modified  to  use  the  appropriate  probability  for  the  various 
search   matricies,    St  (i)  . 

B.  COUNTER-DETECTION 

Another  aspect  of  interest  is  the  idea  of  counter-detection 
of  the  searcher  by  the  target.  It  could  be  speculated  that 
if  the  target  detected  the  searcher  when  they  were  both  in 
the  same  cell  at  the  same  time,  the  search  would  be  blown 
and  therefore  any  target  probability  mass  which  detected  the 
searcher  could  be  removed  from  the  problem.  One  way  of 
accomplishing  this  would  be  to  have  an  added  cell  to  the 
grid.  The  searcher  would  be  unable  to  search  this  cell  and 
the  target  or.ce  in  the  added  cell  would  never  transition 
out.  Then  two  search  matricies  would  have  to  be  used.  The 
modified  search  matrix  St'  would  include  a  probability  of 
counter-detection  and  a  transition  of  that  target  prob- 
ability mass  which  counter-detected  into  the  extra  cell. 
The  search  matrix  St  for  the  wake  search  would  remain 
unchanged-  Figure      5. 1      illustrates      the      problem      input, 

initial  probability  distribution,  target  transition  matrix, 
and    example   search    matricies. 
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Figure  5.1        Search    Problem    Modified    for   Counter-Detection. 


41 


C.        APPBOXIMAPIONS    TO   THE   OPTIMAL    SOLUTION 

For  real  life  problems  on  the  order  of  25x25  grids  and 
larger  with  Tnax>50  and  Tl>5,  the  computer  time  to  reach  a 
close  approximation  of  the  optimal  solution  nay  be  exces- 
sive. Therefore,  Stewart  in  [ Ref .  1]  suggested  using  the 
first  feasible  solution  that  arose  from  the  depth  first 
search.  The  first  solution  could  be  viewed  as  a  form  of  the 
myopic  search.  The  optimality  characteristics  of  such  a 
solution  have  not  been  subjected  to  worst  case  or  average 
case    analysis. 
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¥1.    CONCLUSIONS 

A.       PROBLBH    COMPLEXITY 

Mention  has  been  made  of  tha  apparently  fundamental 
intractability  of  the  discrete  time  and  space  moving  target 
constrained  saarcher  problem.  Earlier  it  was  conjectured 
that  the  problem  is  at  least  MP-Complete  and  possible 
NP-Hard.  Appendix  A  discussed  the  complexity  of  the  problem 
and    provides  some   justification   for    the   conjecture. 

If  the  conjecture  is  true  then  the  implications  are 
clear.  Conventional  attempts  at  trying  to  find  'efficient* 
algorithms  are  doomed  to  failure,  particular ily  if  the 
problem  is  NP-Hard.  Thus  heuristic  algorithms  are  the  most 
fruitful  avenue  for  finding  optimal  or  near-optimal 
solutions. 

B*.       CHOICE    OF   AN    ALGORITHM 

The  myopic  starting  solution  for  Brown's  algorithm 
combined  with  the  best-first  strategy  produces  the  best 
results.  This  combination  was  consistently  better  than  the 
total  enumeration  algorithm  and,  as  the  problem  became  more 
difficult,    performed    better    than    the    other   five    variations. 

The  solutions  to  the  constrained  searcher  problem 
(Stewart's  algorithm  output)  were  compared  for  both  opti- 
mality  and  runtime.  However,  the  solutions  to  the  uncon- 
strained searcher  (Brown's  algorithm  output)  were  not 
compared  except  indirectly  as  the  output  affected  Stewart's 
algorithm.  There  may  be  significant  differences  in  the 
bounds  provided  by  the  different  variations  of  Brown's  algo- 
rithm. It  did  appear  that  the  restart  approach  was  signifi- 
cantly slower      as   Tmax     increased.      This      had   a      significant 
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effect  on  the  performance  of  Stewards  algorithm.  As  Traax 
increased  the  restart  approach  became  increasingly  slower 
than  the  myopic  or  random  approaches  and  the  difference 
could  not  be  explained  by  a  changs  in  the  number  of  solu- 
tions which  had  to  be  calculated.  Thus  even  if  the  opti- 
mality  of  the  bounds  produced  by  the  restart  approach  was 
improved  over  the  other  approaches,  it  was  overshadowed  by 
the  increased  time  required.  It  is  conjectured  that  the  same 
effect   would  occur    if  the   estimation    -echnique   were    used. 

There  are  several  alternative  ways  to  approach  the  solu- 
tion of  the  constrained  searcher  problem.  As  shown  by 
Stewart  in  [Ref.  1],  the  idea  of  network  flows  could  be 
applied.  Also,  J.N.  Eagle  in  [Ref.  5]  proved  that  a  dynamic 
programming  approach  was  guaranteed  to  provide  an  optimal 
solution  for  the  ncn-wake  search  constrained  searcher 
problem.  Either  of  the  above  approaches  may  be  extendable 
to   the   wake    search   case. 

C.       WAKE    SEARCH 

The  extension  of  the  constrained  searcher  problem  to 
deal  with  wakes  rested  on  two  assumptions:  1)  the  indepen- 
dence of  the  searches  and  2)  the  goal  of  uinimizing  the 
probability  of  non-detection  for  a  fixed  time  period  search. 
The  first  assumption  may  not  in  fact  be  valid  under  all 
conditions.  To  say  that  two  searches  have  independent  prob- 
abilities of  detecting  a  target  when  the  searches  are 
constrained   to    use    the  same    search   path    might    be    incorrect. 

For  example,  suppose  that  at  time  period  i  the  target 
moved  from  North  to  South  in  cell  j.  Also  suppose  that  in 
time  period  i+2  the  target  moved  from  East  to  West  in  the 
same  cell  j.  Now  the  searcher  enters  the  cell  at  time 
period  i+4  with  a  5  time  unit  wake  detector.  If  the  searcher 
uses    a      search    plan    that      searches   from      East    to    West      in   an 
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exhaustive  fashion  he  has  several  chances  and  thus  a  higher 
probability  of  detecting  the  tine  period  i  wake  than  the 
time  i+2  wake.  Conversly  if  the  searcher  uses  an  exhaustive 
search  path  from  North  to  South  he  will  have  several  chances 
to  detect  the  wake  from  time  period  i  +  2.  Therefore  it  may  be 
an  oversimplification  to  assume  that  the  wake  searches  are 
all  independent  of  each  other.  The  assumption  did  make  the 
calculations  possible  and  therefore  even  if  the  assumptions 
stretches   the  truth    it  will    still   yield   answers   cf    interest. 
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APPENDIX    A 
DISCUSSION    OP    THE   COMPLEXITY    OP    THE    SEARCH    PROBLEM 

In  this  appendix,  I  hope  to  lay  the  foundation  for  the 
determination  of  the  complexity  of  the  wake  search  problem. 
Tha    problem   will   be    approached   in   two    ways: 

1.  Show  a  restricted  version  of  the  constrained  wake 
search  problem  is   an    element    of    NP. 

2.  Show  that  the  unconstrained  wake  search  problem  is 
functionally  similar  to  tha  Knapsack  Problem  which 
has   been    shown  to    be    NP-Complete. 

As  defined  in  [Ref.  3],  a  problem  is  in  NP  if  a  tenta- 
tive solution  can  be  written  down  and  checked  in  time  poly- 
nomial in  the  size  of  the  problem  input.  The  wake  search 
problem    can    be    formulated  as   follows: 

INPUT:  A  finite  set  J»  {j1 , j2r. • . , jn}  of  cells  which  can 
be  searched,  a  probability  P0=  {p1 ,p2 , . . . ,pn} ,  3<pi<1  for  all 
i=1,N  that  the  target  will  start  the  problem  in  each  cell,  a 
probability  Tij,  0<Tij<1  for  all  i=1,N,  j=1,N  that  the 
target  will  move  from  cell  i  to  cell  j,  a  bound  3>0,  and  the 
sets  I(ji)  for  each  ji,  a  subset  of  J  containing  the  cells 
reachable   fron    cell    ji  in   the   next   time    period. 

QUESTION:  Is  there  a  "search"  of  the  cells  in  J  of 
length  T  having  a  total  probability  of  non-detection  no  more 
than  B  such  that  each  jt+1  is  an  element  of  I  (jt) ?  The  prob- 
ability  of   non-detection   is 


Pnd=Po«ST1«T»ST2»T«ST3«r«. .. •STmax*1]  (A.1) 

Given  the    above    problem    definition,     what    non- 
deterministic  algorithm  will  solve  it  in  polynomial  time?   A 
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non-deterministic  algorithm  is  one  which  contains  two 
srages;  a  guessing  stage  which  simply  guesses  an  arbitrary 
search  j1,j2r...,jr  and  a  polynomial  time  "checker"  which 
answers  the  question,  "does  the  arbitrary  search  have  a 
non-detection  probability  less  than  B?"  It  will  suffice  to 
show  that  the  "checker"  will  stop  in  polynomial  time  and 
answer   the   question,    yes   cr    no. 

The  "checker"  merely  calculates  tha  probability  of  non- 
detection  using  equation  A.  1  and  compares  the  result  with  B. 
The  calculation  entails  (T-1) + (T»rl) ♦ 1  matrix  multiplica- 
tions each  of  which  requires  NxN  multiplications.  Therefore, 
the  calculation  will  require  0(T«rl«N2)  time  to  complete. 
The  input  to  the  problem  has  length  0  (N2+log  (T)  ♦log  (Tl)  )  (N 
elements  of  PO ,  N2  elements  of  Tij,  at  most  M2  elements  of 
I(ji) ,  N  elements  of  the  guessed  search  and  the  values  of  T 
and    Tl.)  If    T   and     Tl    are  restricted      to   be   less      4"han   or 

equal   to   some   specified   polynomial   function   of   8,    P  (N)  ,    then 
the      input      becomes      0(P(N)»N2)       anl      the      calculation      time 
becomes   0(P(N)2«N2),        both    of      which   are      polynomial   in     N. 
Therefore   the  "checker"    will  answer      the  question    in   polyno-* 
mial    time   based      on    the   length   of   the    input.  Based   on   the 

above,  the  wake  search  problem  is  in  NP.  If  the  restriction 
on  the  size  of  T  and  Tl  are  removed  the  problem  may  not  be 
in    NP,    i.e.    the    problem   may    be   NP-Hard. 

Once  it  has  been  shown  that  a  given  problem  is  in  NP,  it 
is  of  interest  to  see  if  the  problem  belongs  to  the  class  of 
problems  called  NP-Ccmplete.  This  class  of  problems  is  known 
to  be  the  set  of  the  hardest  problems  in  NP.  It  is  conjec- 
tured that  the  wake  search  problem  as  described  above  is  no 
easier  than  the  NP-Complete  problems,  however,  a  proof  is 
not  available.  Following  is  a  partial  justification  for  the 
conjecture. 

Proof  that  a  problem  is  NP-Complete  can  be  done  by 
showing   equivalence    between    the   given      problem  and   a    problem 
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already      shown      to      be  NP-Complete.  As      shown      above,        a 

restricted   version    of  the   wake    search    problem    is    in    NP.      Now 

if    it      could  be      shown  that      the   wake      search   problem      is   no 

easier  than   a      problem  which   is  NP-Complete      the    proof   would 

be    done.    What   will    be  done    is   to   show   that    a   relaxed    version 

of   the      wake  search    problem      namely   the    wake      search   problem 

where   the      searcher    motion    is    unconstrained      is   functionally 

similar   to   the    knapsack   problem    whioh   is   NP-Complete. 

The   knapsack   problem    ran   be   stated   as    follows: 

GIVEN:      Finite    set  a,    for    each   u    U   a   size    s(u)       Z+    and   a 

value   v(u)    Z+,    and    positive    integers    B  and    K. 

QUESTION:         Is      there      a      subset         o»      of      0      such      that 

£        s(u)<B   and    such   that      £        v(ui>K? 
U£tP  aeU* 

The      unconstrained  searcher      problem      can      be    stated     as 

follows : 

GIVEN:  a  finite  set  JxTmax,  a  finite  set  T,  a  finite  set 
Po,  for  each  jt  JT  a  size  s(ji)=1  and  a  value  v(ji)=Pndf  and 
a   positive   integer    Tmax   and    a    rational   number    K<1. 

QUESTION:    Is    there  a    search   J={  j1  ,.  . .  ,  jTm  ax}     a   subset    of 

JxTmax,      such  that    each   element    ji   of   J    is    an   element   of   the 

disjoint    subset    JI    where   the   subsets      JI    form   a    partition   of 

Tmax 
JxTmax   and   such    that     I        s(ji)=Tmax      and   such   that    equation 

i=1 
A.  1     <K? 

While  there  appears  to  be  significant  differences 
between  the  wake  search  problem  and  the  knapsack  problem, 
there  is  enough  similarity  that  the  conjecture  that  the  wake 
search  prcblei  is  at  least  as  hard  as  the  knapsack  problem 
is  reasonably  justified.  Since  the  wake  search  problem  as 
compared  to  the  knapsack  problem  is  the  unconstrained 
version  it  also  appears  that  the  constrained  wake  search  is 
also    at   least   as   hard. 

It  has  been  shown  that  a  restricted  version  of  the 
constrained  wake  search  problem  is  in  NP.  It  can  be  hypoth- 
esized that    if    the    restriction    (that      P    and   ri   be    polynomial 
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functions  of  N)  were  removed  the  problem  would  not  be  in  NP. 
It  has  also  been  shown  that  the  unconstrained  wake  search 
problem  is  functionally  similar  to  a  problem  which  has  been 
previously  determined  to  be  NP-Complete.  Therefore,  it  seems 
reasonable  to  conjecture  that  the  constrained  wake  search 
problem  is  at  least  NP-Complete  and  possibly  NP-Hard.  The 
consequences  of  this  conjecture  are  that  the  problem  is 
fundamentally  intractable  and  thers  do  not  exist  'efficient' 
algorithms  for  solving  the  problem.  Thus  any  heuristic  algo- 
rithms such  as  those  presented  in  this  thesis  are  appro- 
priate methods  for  attempting  to  find  optimal  or 
near-optimal  solutions. 
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APPENDIX    B 
GRAPHICAL    COMPARISON    OF    AL30RITHH    RUNTIMES 

This   appendix     contains    graphs      of   tha      runtimes   of      the 
algorithms   for    the    following  cases: 

1.  4   cell  grid,    T1*0,    and   Tmax=1  ,  13 

2.  4   cell  grid,    Tl*1 ,    and   Tmax=1,13 

3.  4   cell  grid,    Tl=2,    and   Tmax=1,10 

4.  9  cell  grid,    T1=0 ,    and    Tmax=1,13 

5.  9    cell  grid,    Tl=1,    and   Traax=1,10 

6.  9   cell  grid,    Tl=2  ,    and    Tmax=1 , 13 

7.  16   celL    grid,    T1=0,    and   Tmax=1,10 

8.  16   cell    grid,    Tl= 1 ,    and   Tmax=1,10 

9.  9)    16   -ell   grid,    Tl=2,    and   max=1,10 

10.  25   cell    grid,    Tl=0,    and   Tmax=1,10 

11.  25   cell    grid,    Tl=1,    and   Tmax=1,10 

12.  25   cell    grid,    Tl=2,    and   Tmax=1,10 

Each  graph  contains  the  runtimes  for  each  of  tha  seven  algo- 
rithms, with  the  following  symbols  r=prssenting  each  algo- 
rithm : 

Depth-First    Strategy,    myopia    starting    solution 
*      -      Depth-First    Strategy,    randon    starting    solution 
+      -      Depth-First    Strategy,    restart    algorithm 
x      -      Best-First   Strategy,    myopic   starting   solution 
V      -      Best-First  Strategy,    random   starting   solution 
A      -      3est-First   Strategy,    restart    algorithm 
o      -      Total  Enumeration 
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Figure  B.I    H   Cell  Grid,  TIO,  and  Tmax=1,10. 
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Figure  B. 2        4  Call    Grid,    Tl=1,    and   Taax=1,10. 
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Figure  B. 3   U  Cell  Grid,  Tl=2,  and  Taax=1,10. 
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Figure  B.U    9  Cell  Gridr  Tl-3,  and  Tmax=1,10. 
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Figure  B.5    9  Cell  Grid,  Tl=1,  and  Tmax=1,10 
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Figure  B.6    9  Call  Grid,  Tl=2,  and  Taax=1,10. 
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Figure  B.7    16  Call  Grid,  Tl=0,  and  Taax=1,10. 
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Figure  B.8        16  Cell    Grid,    Tl-1,    and   Tmax=1,10. 
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Figure  B.9    16  Cell  Grid,  Tl=2,  and  Tmax=1,10 
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Figure  B.10        25  Cell    Grid,    ri  =  0,    and   Tmax=1 , 10. 
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Figure  B.11        25  Cell    Grid,    TL  =  1,    and   rmax=1#10. 
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Figure  B.12        25  Cell    Grid,    Tl  =  2,    and  Tmax=1,10. 
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